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Abstract 

In this paper we develop the interpolating cavity field technique 
for the mean field ferromagnetic p-spin. The model we introduce is 
a natural extension of the diluted Curie- Weiss model to p > 2 spin 
interactions. Several properties of the free energy are analyzed and, in 
particular, we show that it recovers the expressions already known for 
p = 2 models and for p > 2 fully connected models. Further, as the 
model lacks criticality, we present extensive numerical simulations to 
evidence the presence of a first order phase transition and deepen the 
behavior at the transition line. Overall, a good agreement is obtained 
among analytical results, numerics and previous works. 

1 Introduction 

Born as a theoretical background for thermodynamics, statistical mechanics 
provides nowadays a flexible approach to several scientific problems whose 
depth and wideness increases continuously. In fact, in the last decades statis- 
tical mechanics has invaded fields as diverse as spin glasses neural net- 
works m, protein folding [H], immunological memory [22], social networks 
[TT] . theoretical economy [12] and urban planning [8]. As a consequence, an 
always increasing need for models and proper techniques must be fulfiUed. 
Coherently, recently, several models have been systematically tackled via the 
smooth cavity field by the authors, namely the Curie- Weiss model [S], the 
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Figure 1: Schematic representation of the connections among different mod- 
els based on mean field interactions between variables endowed with discrete 
symmetry. 

fully connected p-spin model [H], the Sherrington-Kirkpatrick model [1], its 
diluted counter part Viana-Bray model [7] and the diluted ferromagnetic 
model 0. All these models can just be seen as different components of a 
more general class including models based on binary agents with mean field 
interactions (Fig. [T|. Now, in order to complete the analysis of the free 
energies for the whole class, the X-OR-SAT (of the Random Optimization 
Theory [I9]) and the diluted ferromagnetic p-spin model, are still missing; 
this paper is devoted to the study of the latter. 

In a nutshell, the system is a ferromagnet in which the interactions happen 
in p-plets, instead of more classical couples, and the interacting agents live 
on a diluted random network, i.e. the Erdos-Renyi graph. In general, the 
graph can be specified by fixing the number of nodes N and its "connectivity" 
a, which represents the number of nearest neighbors per site. 
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As standard ferromagnets, the model is shown to exhibit two phases, a 
paramagnetic one and a (replica symmetric) ferromagnetic one, on the the 
other hand, as a difference with respect to the standard ferromagnet, the 
phase transition does not display criticality for p > 2. The model is investi- 
gated by means of cavity field technique and extensive numerical simulations. 

We find an expression for the free energy as a function of p, of the net- 
work connectivity a and of the (inverse) temperature /?, showing that it is 
consistent with known results. In particular, by properly tuning -p and a we 
recover the Curie- Weiss model [5], the diluted Ising model [2j and the fully- 
connected p-spin model [B]; moreover, regardless of the (finite) dilution, for 
p = 2 criticality is restored. Full agreement with Monte Carlo simulations is 
obtained both on the absence of the critical behavior and on the free energy 
structure. 

The paper is organized as follows: In Section 2 the model is introduced 
and some of its properties worked out together with the introduction of a 
proper statistical mechanics machinery, while in section 3 its equilibrium 
is solved via the smooth cavity field technique. Section 4 deals with the 
properties of the free energy and its consistency with well known models, 
while in section 5 our numerical analysis is presented. Section 6 is left for 
a summary and outlook. Finally, Section 7, as an Appendix, contains the 
detailed proofs of the theorems introduced. 

2 The diluted even-p-spin ferromagnet 

In this section we explore the properties of a diluted even-p-spin ferromagnet: 
we restrict ourselves only to even values of p for mathematical convenience 
as the investigation with the cavities is much simpler. However, due to 
monotonicity of all the observables in p, such restriction does not imply any 
loss of generality, as confirmed also by numerical simulations performed on 
both even and odd values of p. 

Before proceeding, it is worth recalling some concepts concerning the 
diluted random network where the magnetic system is set. Such a network is 
an Erdos-Renyi graph [27] defined as follows: given a number N of nodes, we 
introduce connections between them in such a way that each pair of vertices 
j has a connecting link with independent probability equal to a/A^, with 
< a < A^. As a result, the probability distribution for the number of links 
per node (or coordination number) is binomial with average a. Hence, the 
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parameter a provides a measure of the "degree of connectivity" of the graph 
itself: the smaller a the more diluted the system; for a = and a = N the 
extreme cases of fully disconnected and fully connected graphs, respectively, 
are recovered. Notice that in the thermodynamic limit N —>■ oo the binomial 
distribution converges towards the Poisson distribution [9j. 

The ER graph can be algebraically described by the so-called adjacency 
matrix A which is an x symmetric matrix whose entry Aij is 1 if i 7^ j 
and the two nodes are connected together, otherwise it is zero. 

We now associate to each node i a binary variable at = ±1, i G [1, A^] and 
we introduce p families {il}, {il}, {i-^} of i.i.d. random variables uniformly 
distributed on the previous interval. Then, the Hamiltonian is given by the 
following expression 



where k represents the number of connected p-plets present in the graph. 
Reflecting the underlying network. A; is a Poisson distributed random variable 
with mean value 7A^. The relation among the coordination number a and 7 
is 7 oc a^"^: this wfll be easily understood a few lines later by a normalization 
argument coupled with the high connectivity limit of this mean fleld model. 

The quenched expectation of the model is given by the composition of the 
Poissonian average with the uniform one performed over the families {i^} 



where the term A^^ ^ A^!/(A^— p)! accounts for the number of possible ordered 
p-plets. 

As they will be useful in our derivation, it is worth stressing the foUowing 
properties of the Poisson distribution: Let us consider a function : N — M, 
and a Poisson variable k with mean 7A, whose expectation is denoted by E. 

It is easy to verify that 




(1) 



u=l 





E[kg{k)] 

d^N^gik)] 



-fNE[g{k - 
E[g{k + 1) 
E[g{k + 2) 



1)] 



2gik + l)+gik)]. 



(3) 
(4) 
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The Hamiltonian written as in eq. ([T|, has the advantage that it is the 
sum of (a random number of) i.i.d. terms. To see the connection to a 
more familiar Hamiltonian written in terms of adjacency matrix elements, 
we first notice that being a/N the probability that two nodes are connected, 
among the A^*' possible p-plets, the number of connected p-plets is Poisson- 
distributed with average a^'^N + 0{VN) for large A^. We now define the 
adjacency tensor Ai^^,,,^i^ = Ai^^i^Ai^^i.^...Ai^^i^ which equals 1 whenever the 
p-plet ii, occurs to be connected; Ai^^,,,^i^ is Poisson distributed and has 
mean 'jN/N^ ~ {a/Ny~^. Hence, we can write the following Hamiltonian 
which is thermodynamically equivalent to HNicr,'j) appearing in eq. Q: 



N 



-if7v(cr;7) i^Ar(a;A)= ^ Ai^^,„.i,^ai^...ai^. (6) 

ii,...,ip 

Then, it is enough to consider the streaming of the following interpolating 
free energy (whose structure proves the statement a priori by its thermody- 
namic meaning), depending on the real parameter t G [0, 1] 

(f){t) = — ln^e^^^'=i'''i-'''S+^H....,«P^n....«p'^n-'^>p)^ 
(J 

where is a Poisson random variable with mean jNt and Aii,...,ip are random 
Poisson variables with mean (1 — t)'^/N^~^. In this way the two separated 
models are recovered in the two extremals of the interpolation (for t = 0, 1). 
By computing the t-derivative, we get 

= Eln(l + fi(a,j...a,g)tanh(/3)) (7) 

N 



\- ln(l + ^](a,,...a,Jtanh(/5)) = 0, 



where the label in Iq stands for a new spin, born in the derivative, according 
to the Poisson property ^\ as the ?o's are independent of the random site 
indices in the t-dependent ^2 measure, the equivalence is proved. 

Following a statistical mechanics approach, we know that the macroscopic 
behavior, versus the connectivity a and the inverse temperature [3 = 1/T, is 
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described by the following free energy density (often called quenched pressure) 
A{a,/3) = lim AN{a,(3) (8) 

N—*oo 

= lim lElnZjv(7,/3), 

N—^CO I\ 

where 

Z^(7,/3) = 5^e-/^^-('^'^) (9) 

Wl 

is the partition function. Taken g{a) as a generic function, the Boltzmann 
state is therefore given by 

with its replicated form 

n{g{a))^l[u;^^\g{a(^^)) (11) 

s 

and the total average {g{cr)) is defined as 

{g{a))^EMg{a))]. (12) 



Let us introduce further, as order parameters of the theory, the multi-overlaps 



i=l 



with a particular attention at the magnetization m — qi — (1/-/V) X^^i Cj 
and to the two rephca overlap qi2 = (1/-/V") X^ili 

The normalization constant of the quenched pressure can be checked by 
performing the expectation value of the cost function: 



E[H] = --fNmP 

N 



E[H']-E'[H] = fiV^ (g^2-m^) + 0(l) , (14) 
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by which it is easy to see that the model is well defined, in particular it is 
linearly extensive in the volume N. Then, in the high connectivity limit each 
agent interacts with all the others {a ~ A^) and, in the thermodynamic hmit, 
a —>■ oo. Now, such a high-connectivity limit, i.e. a linear divergence of a, is 
properly recovered for any finite p, p < N. In particular, if p = 2 the amount 
of couples in the summation scales as A^(A^ — l)/2 and 7 = 2a; if j9 = 3 the 
amount of triples scales as A^(A^ — 1)(A^ — 2)/3! and, with 7 = 3!q;^. 

Before starting our free energy analysis, we want to point out also the 
connection between this diluted version and the fully connected counterpart. 
Let us remember that the Hamiltonian of the fully connected p-spin model 
(FC) can be written as [H] 

HN^i(^) = J2 (^h(^i2--^i,^ (15) 

l<il<...<ip<N 

and let us consider the trial function A{t) defined as follows 

A{t) = -Eln^exp [p ^^^^-^^ + (1 - n^^"] , (16) 

which interpolates between the fully connected p-spin model and the diluted 
one, such that for t = only the fully connected survives, while the opposite 
happens for t = 1. Let us work out the derivative with respect to t to obtain 

dtA{t) = (p- l)aP-Mncosh(/3) (17) 
- (p-l)a^^^$^^^'^(g^)-|(m^), 

n 

by which we see that the correct scaling, in order to recover the proper 
infinite connectivity model, is obtained when a ^ 00, P ^ and P' = 
2{p— l)a*'~^ tanh(/3) is held constant. 

Remark 1. It is worth noting that for p = 2 we recover the correct scaling of 
the diluted Curie- Weiss model [2], furthermore the dilute p-spin model reduces 
to the fully connected one, in the infinite connectivity limit, uniformly in the 
size of the system. 
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3 The smooth cavity approach 



In this section we want to look for an iterative expression of the free energy 
density by using a version of the cavity strategy [H [5] that we briefly recaU: 
the idea behind the cavity techniques [HIIIB], which, for our purposes, resem- 
bles the stochastic stability approach [iQlEI], is that information concerning 
the free energy density can be extrapolated when looking at the incremental 
extensive free energy given by the addition of a spin. 

In diluted models, this additional spin changes also (inflnitesimally in the 
high N limit) the connectivity and, in evaluating how the free energy density 
varies conformingly with this, we are going to prove that it can be written 
by a cavity function and such a connectivity shift. 

So the behavior of the system is encoded into these two parts. The latter is 
simpler as it is made up only by stochastically stable terms (a proper defini- 
tion of these terms will follow in the current section). Conversely, the former 
term needs to be expressed via these terms and this must be achieved by 
iterative expansions. 

At first we show how the free energy density can be decomposed via 
these two parts (the cavity function and the connectivity shift). Then, we 
analyze each term separately. We will see that they can be expressed by 
the momenta of the magnetization and of the multi-overlaps, weighted in a 
perturbed Boltzmann state, which recovers the standard one in the thermo- 
dynamic limit. 

Theorem 1. In the thermodynamic limit, the quenched pressure of the even 
p-spin diluted ferromagnetic model is given by the following expression 



A(a,p) = ln2 -A(a,/3) + = 1), 

p — Ida 



(18) 



where the cavity function \E'(t, q;,/5) is introduced as 




E In 




E In 



^iv(7,/3,t), 



(19) 



with 



^{j,P,t) = lim ^N{l,P,t). 



(20) 
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For the sake of clearness and to avoid interrupting the paper with long tech- 
nical calculations, the proof of the theorem is reported in the Appendix. 
Thanks to the previous theorem, it is possible to figure out an expression for 
the pressure by studying the properties of the cavity function and 
the connectivity shift daA{a,f3). 

Using the properties of the Poisson distribution ([3l[4|, we can write 



d 

da 



Aia,P) 



N 



dj 



Now considering the relation (and definition) 



Pa A...a V 

e 



cosh /3 + cTj 1 ... CTjP sinh , 
tanh /3, 



we can write 



d 



da 

{p - l)aP~'^ In cosh /5 + E[ln(l + cj(aii ...a^p 

At the end, expanding the logarithm, we obtain 

d 



da 



A{a,[3) 



{p — l)a^ In cosh (3 



{p - l)a^-' J2 



.l)n 



n=l 



n 



(21) 
(22) 



(23) 



(24) 



With the same procedure it is possible to show that 
d 



dt 



^(a,/?,t) = 2aP~Mncosh/5 



^ n 



'^^{Ql,...,n)a,t, 



n=l 



(25) 



where 

a = a 

La^ + iJ 

Now, by eq. ([25|, we see that even the cavity function, once the r.h.s. of 



eq.(25) is integrated back against t, can be expressed via all the order pa- 



rameters of the model: 



vi/(«,/?,t) = 2a^-i(lncosh(/5) - ^ fiq^J^^t 



So, as expected, we can understand the properties of the free energy by 
analyzing the properties of the order parameters: magnetization and over- 
laps, weighted in their extended Boltzmann state Uf 

Further, as we expect that the order parameters is able to describe thermo- 
dynamics even in the true Boltzmann states uj,fl [IT], accordingly to the 
following definitions, we are going to show that filled order parameters (the 
ones involving even numbers of replicas) are stochastically stable or, in other 
words, are independent of the t-perturbation in the thermodynamic hmit, 
while the others, not filled, become filled, again in this limit (such that even 
for them cj^ — > in the high limit and thermodynamics is recovered). The 
whole is explained in the following definitions and theorems of this section. 

Definition 1. We define the t-dependent Boltzmann state Ut as 

Cot{g{a)) = (26) 



where Zj^^t{l,P) extends the classical partition function in the same spirit of 



the numerator of eq.(26] itself, and 7 = 7(1 + ^) 



We see that the original Boltzmann state of a A^-spin system is recovered 
as t approached 0, while, in the limit t ^ 1 and gauging the spins, it is 
possible to build a Boltzmann state of a A^ + 1 spins, with a little shift both 
in a, 13, which vanishes in the N —>■ 00 limit. 

Now, coherently with the implication of thermodynamic limit (by which 
AN^i{a,(3) — AN{a,/3) = for A^ ^ 00), we are going to define the filled 
overlap monomials and show their independence (stochastic stability) with 
respect to the perturbation encoded by the interpolating parameter t. These 



10 



parameters are already 'good" order parameters describing the theory, while 
the others (the not-filled ones) must be expressed via the formers, and this 
will be achieved by expanding them with a suitably introduced streaming 
equation. 

Definition 2. We can split the class of monomials of the order parameters 
in two families: 

• We define filled or equivalently stochastically stable those overlap mono- 
mials with all the replicas appearing an even number of times (i.e. q\2, 

m^, gi2g34gi234j- 

• We define non-filled those overlap monomials with at least one replica 
appearing an odd number of times (i.e. qu, m, quqsi)- 

We are going to show three theorems that will play a guiding role for our 
iteration: as this approach has been deeply developed in similar contexts (as 
fully connected Ising and p-spin models |5l [6], fully connected spin glasses 
|4j or diluted ferromagnetic models [21 E], which are the "boundaries" of the 
model of this paper) we will not show all the details of the proof, but we 
sketch them in the appendix as they are really intuitive. The interested 
reader will found a clear derivation in the appendix and can deepen this 
point by looking at the original works. 

Theorem 2. In the thermodynamic limit and setting t = 1 we have 

0JN,t{(^ii'^i2--'^in) = '^Af+l(0"n0"i2---'^in'^7V+l)- (27) 

Theorem 3. Let Qab be a not-filled monomial of the overlaps (this means 
that qabQab is filled). We have 

lim \im{Qab)t = (qabQab), (28) 

( examples: 

/or iV oo we get {mi)t {ml), {qi2)t ^ (gDJ- 

Theorem 4. In the N ^ oo limit, the averages (•) of the filled polynomials 
are t-independent in [3 average. 
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4 Properties of the free energy 



In this section we are going to address various points: at first we work out the 
constraints that the model must fulfil, which are in agreement both with a 
self-averaging behavior of the magnetization and with the replica-symmetric 
behavior of the multi-overlaps [23]; then we write an iterative expression for 
the free energy density and its links with known models as diluted ferromag- 
nets (p — > 2 limit) and fully connected p-spin models (a — > cxd limit). 
With the following definition 

p = 2{p-i)ap-^e (29) 

we show (and prove in the Appendix) the streaming of rephca functions, by 
which not filled multi-overlaps can be expressed via filled ones. 

Proposition 1. Let Fg be a function of s replicas. Then the following stream- 
ing equation holds 

= /3[X](F.mr^),,-.(FX;!),,] (30) 

a=l 

l,s s 
a<b a=l 



+ 



+ 



Remark 2. We stress that, at the first two level of approximation presented 
here, the streaming has the structure of a 9-weighted linear sum of the Curie- 
Weiss streaming (9^ term) [Sj and the Sherrington-Kirkpatrick streaming (6^ 
term) providing mathematical structures of disordered systems with a 
certain degree of independence with respect to the kind of quenched noise 
(frustration or dilution). 



It is now immediate to obtain the linear order parameter constraints 
(often known as Aizenman-Contucci polynomials |3l [5l |9]) of the theory: 
in fact, the generator of such a constraint is the streaming equation when 
applied on each filled overlap monomial (or equivalently it is possible to apply 
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the streaming on a not-filled one and then gauge the obtained expression; for 
the sake of clearness both the methods will be exploited, the former for q2 
and the latter for m). 

As examples, dealing with the terms m^^^ and ^2^, it is straightforward 
to check that 



= jim ^^^^^ ^''^ = P[{ml^'-'^) - (mr^)^) 

+ /3^((mr^gr') - (^r')(gr')) + oie'), 



then, by gauging the above expression, in the thermodynamic limit, (as 

limAr^oo("^^~^)i {mP)), we get 

- + 0{{ql') - {qlf )) =0, ^ee 7^+ 



The fact that the previous expression holds for every 9 suggests self-averaging 
for the energy (by which all the hnear constraints can be derived [9j) due to 
the first term, as well as replica symmetric behavior of the two replica overlap 
due to the last one. Analogously, the contribution of the generator is 



= (((gf2X"') + (??2^'^r^)-2(g?2~^mr^)) + 

+ 0{{ql-\l-')-A{ql-\l-')^^ql-\ll'))), 

which shows replica symmetric behavior of the magnetization by the first 
term and the classical Aizenman-Contucci relations |3l |^ by the latter. 

Furthermore, turning now our attention to the free energy, it is easy to 
see that the streaming equation allows to generate all the desired overlap 
functions coupled to every well behaved Fg. In this way, if Fs is a not filled 
overlap, we can always expand recursively it into a filled one, the only price 
to pay given by the 6 order that has to be reached or, which is equivalent, 
the number of derivatives that have to be performed. 



Let us now remember the t-derivative of the cavity function (25), showing 
explicitly the first two terms of its expansion 

^^{a,P,t) = 2aP-Mncosh/3 + /3(mr^)<5,t- (31) 

^ ft 

n=3 
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As derivative of fillable terms involve filled ones, we can arrive to an an- 
alytical form of ^(a, (3) if we calculate it as the t-integral of its t-derivative, 
together with the obvious relation = 0) = 0. Hence, if we apply the 
streaming equation machinery to the overlaps constituting equation (31), we 
are able to fill them and to remove their t-dependence in the thermodynamic 
limit. In this way we are allowed to bring them out from the final t-integral. 
In fact, without gauging (so, not only in the ergodic regime, where symme- 
tries are preserved), we can expand the streaming of {mP~^)t: 



d{m\ ) 
Jt 



2(p-l) 



+ 



p— 1 p— i\ 



We can note the presence of the filled monomial (m^*^^^^''), whose t-dependence 
has been omitted explicitly to underline its stochastic stability, while the over- 
laps (m^~^m2~^)j and {m{~'^qi2^)t can be saturated in two steps of streaming. 
This will be sufficient, wishing to have a fourth order expansion for the cavity 
function. 

We now derive these two functions and apply the same scheme to all the 
overlaps that appear and that have to be necessary filled in order to obtain 
the desired result. 

p— 1 p— i\ 



[m 



dt 

2(p-i)^p-i 



ml )t - {m{ 



p— 1 p— 1 p— 1 



+ 



{m\ ^qi2 ^) — 4(m^ 



p— 1 p— 1 p— i\ 



m 



(32) 



dt ~ 



unfilled terms 



Integrating back in t and neglecting higher order terms we have 



(33) 



{mi 



2(p-l) «-l 



TTln 



)t = (3 (m^ 



2{p-l)2(p-l) 



rrio 



(34) 
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and we can write 



(35) 



2{p-l)2ip-l)\,2 



m 



Let us take a look now at the other overlap {m\ ^g^2 ^)t'- 
d(m\~^ql~^)t 



dt 



I 2(p— 1) p— 1\ / p— 1 p— i p— i\ 



p— 1 p— 1 p— 1\ 



(36) 



that gives 



p— 1 p— 1 p— 1\ 



(37) 



At this point we can write for (m^ '^)t,a (and consequently for (g^2 ^)t,a) 



,p-i\ 



2(p-l)\, , 2{p-l)_2(p-l) 



(3{mi )t — —{rrii 



PO{qT'^)t + p-'{m'rmlVu')t' + 0{9 



p-l^p-l^p-l\ j2 



With these relations, eq. (31) becomes 
d 



dt 



^iv(a,At) = 2aP'Hncoshf3 + p\mfP'^>)t 
P^9\ 2(p-i),, SP^0 



/3\ z 



2(p-1)^2(p-1)\,3 



m 



)t^ + o(e^ 



which ultimately allows us to write an iterated expressions for \l/ evaluated 
at t = 1 



^jv(a,Al) = 

2a^-Mncosh/3+ ^(m?^-^)) - ^{glf^ 



)- 



I p— 1 p— 1 p— i\ 



12 



2(p-l)_2(p-l)w3 



)r + 0(^^). 



(38) 
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Overall the result we were looking for, namely a Landau-like polynomial form 
for the free energy, reads off as 



A{a,f3) = ln2 + aP-Mncosh/3+ (39) 
+ Y(/5'(m2(P-i))-(mO) + 



Now, several conclusions can be addressed from the expression (39): 
In fact, as we are going to see immediately through remarks, this formula 
can bridge free-energies of quite different models (diluted versus non-diluted, 
critical versus uncritical) and acts as a general free energy expression close 
to the phase transition. 

Remark 3. At first let us note that, by constraining the interaction to be 
pairwise, critical behavior should arise [17J. Coherently, we see that for p = 2 
we can write the free energy expansion as 

A{a,P),=2 = In 2 + alncosh(/5) - |(1 - f3'){m') - ^{ql), 

which coincides with the one of the diluted ferromagnet ^ and displays crit- 
icality at 2a6 = 1, where the coefficient of the second order term vanishes, 
in agreement with previous results [2] and Landau theory fTT^ . 

Remark 4. The free energy density of the fully connected p-spin model is JFj 
A{P') = ln2 + lncosh(/5mP~^) — {[3/2)mP , which coincides with the expansion 



(39) in the limit of a oo and P ^ with f3' = 2{p — l)^^ ^9. 



Remark 5. It is worth noting that the connectivity no longer plays a linear 
role in contributing to the free energy density, as it does happen for the di- 
luted two body models ^ f75|/ . This is interesting in applications to economic 
networks, where, for high values of coordination number it may be interesting 
to develop strategies with more than one coupling ^24j- 

5 Numerics 

We now analyze the system described in the previous section, from the numer- 
ical point of view by performing extensive Monte Carlo simulations. Within 
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this approach it is more convenient to use the second Hamiltonian introduced 
(see eq.Q): 

TV N 

HN{(T,A) = -^ai^ Ai^^,„^i^ai,ai^...ai^. (40) 

k «2<«3<---<ip=l 

The product between the elements of the adjacency tensor ensures that the 
p — 1 spins considered in the second sum are joined by a hnk with ii. 
The evolution of the magnetic system is reahzed by means of a single spin-flip 
dynamics based on the Metropolis algorithm |2U]. At each time step a spin is 
randomly extracted and updated whenever its coordination number is larger 
than p — 1. For a large enough (at least above the percolation threshold, as 
obviously holds for the results found previously) and p = 3,4 this condition 
is generally verifled. The updating procedure for a spin cij works as follows: 
Firstly we calculate the energy variation AEi due to a possible spin flip, 
which for p = 3 and p = 4 reads respectively 

N 

AEi = 2(Ti ^ AijAi^k(^jak, (41) 
j<k=i 

N 

AEi = 2(Ti ^ AijAi^kAi^wCrjdkCTw. (42) 

j<k<w=l 

Now, if AEi < 0, the spin-flip cTj —ai is reahzed with probability 1, 
otherwise it is realized with probability e~^^^. 

The cases p = 3, 4 were studied in detafls, while for p = 2 we refer to [2]. 
Our investigations are aimed to evidence the existence of a phase transition 
and its nature and also to highhght a proper scaling for the temperature as 
the parameter a is tuned. 

As for the first point, we measured the so-called Binder cumulants defined 
as follows: 

- 1 - (43) 

where {■)n indicates the statistical average obtained for a system of size N 
and T = (3~^ [25]. The study of Binder cumulants is particularly useful to 
locate and catalogue the phase transition. In fact, in the case of continu- 
ous phase transitions, Gjq{T) takes a universal positive value at the critical 
point Tc, namely all the curves obtained for different system sizes cross 
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Figure 2: Binder cumulants GiiT) for systems with p = 3 and different 
size iV, as shown in the legend, and connectivity a = 50 (left panel) and 
alpha = 80 (right panel). 



each other. On the other hand, for a first-order transition G'Ar(T) exhibits 
a minimum at T^m, whose magnitude diverges as N. Moreover, a crossing 
point at Tcross can be as well detected when curves pertaining to different 
sizes N are considered ^B]. Now, T^m and Tcross scale as Tmin — oc A^~^ 
and Tcross — oc N~^, respectively. 

In Fig. [2] we show data for G'Ar(T) obtained for systems of different sizes 
(N = 400, N = 500, and = 800) but equal connectivity {a = 50 and 
a = 80, respectively) as a function of the temperature T. The existence of 
a minimum is clear and it occurs at T 625 and T ^ 1600. Similar results 
are found also for p = 4 and they all highlight the existence of a first-order 
phase transition (hence lack of criticality) at a temperature which depends 
on the connectivity a. 

In order to deepen the role of connectivity in the evolution of the system 
we measure the macroscopic observable (m) and its (normalized) fiuctuations 
(m^) — (m)^, studying their dependence on T and on a. Data for different 
choices of size and dilution are shown in Figure [3] for j9 = 3 and in Figure [4] 
for p = 4. 

The profile of the magnetization, with an abrupt jump, and the cor- 
respondent peak found for its fiuctuations confirm the existence of a first 
order phase transition at a well defined temperature whose value depends 
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2 4 „ 6 8 10 

Figure 3: Magnetization (main figure) and its normafized fluctuations (inset) 
for 3-spin systems of different sizes and different dilution as a function of 
oP~^ . The coUapse of all the curves provides a strong evidence for the 
scahng of the temperature. 



on the dilution a. More precisely, by properly normalizing the tempera- 
ture in agreement with analytical results, namely P = P we found a 
very good collapse of all the curves considered. Hence, we have agreement 
among analytic and numerics concerning the scahng of the temperature as 
a'P'^. Moreover our data provide a very clear hint suggesting that the criti- 
cal temperature can be written as = f{p)aP~^, where f{p) is a monotonic 
decreasing function of p. 

6 Conclusions 

In this paper we performed an analysis of the ferromagnetic diluted p-spin 
model via cavity field technique and numerical simulations. Several ques- 
tions have been addressed, including an expression for the free energy, the 
self-averaging famflies for the order parameters and a study of the phase tran- 
sition among a paramagnetic and a ferromagnetic regime. Despite a rigorous 
picture for the lacking of replica symmetry breaking in diluted ferromagnet 
is still unavailable, we supported strong evidence toward a full replica sym- 
metric behavior in the whole phase diagram. In particular, we showed the 
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Figure 4: Magnetization for 4-spin systems of different sizes and different 
dilution as a function of (3 a^~^. The collapse of all the curves provides a 
strong evidence for the scahng of the temperature. 



vanishing of criticality for p > 2 and we found a proper scaling for the tran- 
sition temperature as a function of the system dilution, namely Tc ~ a^~^ . 

Further development should be two-fold: from one side the same analysis 
is still to be performed on the X-OR-SAT model which constitutes another 
element making up the class of models based on binary agents with mean 
filed interaction. On the other side, the whole mathematical architecture 
still suffers a not exhaustive development; in fact the difference among even 
and odd p model, at least for large p, is thermodynamically almost irrelevant, 
while the lacking of the gauge symmetry in the latter rules out the method at 
this stage. Moreover, it is highhghted the need to develop a Hamilton-Jacobi 
technique |I3] in order to handle this kind of problem to avoid the iteration 
procedure imphed by the cavity method. 

7 Appendix: Analytical proofs 

In this section the proofs of al the Theorems and the Proposition 1 are 
reported. 

Proof of Theorem [T] 

Bridging a system made of by + 1 spins with one made of by N spins 
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implies the definition of rescaled 7, a parameters, accordingly to [2]|n] 

7 = 'yj^^ — ' 7 (44) 



a = a 



N 1 p-i N^oo 



N + 1 



a. (45) 



We have, in distribution, the Hamiltonian of a system made of + 1 particles 
writable as 

HN+i{a,-f) = - aiiaii-MiP ~ (46) 

that we may rewrite as 

i/^+i(a,7) = H^{a,^) + HN{a,2^). (47) 



Following the above decomposition, let us consider the partition function of 
the same N + 1 spin model and let us introduce the gauge transformation 
(jj (jj(jAr+i which is a symmetry of the Hamiltonian known as spin-flip. 

Zn+i{i,(3) ~ e-/3/^ivK7)-/3J?^(-,7W+i = (48) 

{o-jv+i} 

E/3Hjv(o-,7)+/3 Xl^Ji OA ...o-.p_i(T]v+i 
g V = 

{o-jV+l} 

where the new Boltzmann state u), and its replicated f2, are introduced as 

El. X (7(fT)e-'3^^(^''^) 

f^(5(^)) = n'^^^^(^(^^'^))- (50) 
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To continue the proof we now take the logarithm of both sides of the last 
expression in eq. (48), apply the expectation E and subtract the quantity 
E[lnZjv+i(7,/3)]. We obtain 

E[lnZ^+i(7,/5)] -E[lnZ^+i(7,/5)] = 

ln2 - E[ln + ^n{i, P, 1), (51) 



The left hand side gives 



E[lnZAr+i(7,/?)] - E[lnZ^+i(7,/?)]= (52) 

1 d 



(7-7)— E[lnZw+i(7,/3)]|^=^ 



7=7 



7^A;v+i(7,/5)- (53) 



Considering the a dependence of 7, we have 

d (X ^ d =^ ^ A(x ^ A 

where the symbol oc instead of = reflects the arbitrariness by which we include 
the p\ term, multiplying a, inside the definition of 7, or directly in a. 
Performing now the thermodynamic limit, we see that at the right hand side 
we have 

limE[ln^±ii^^]^A(a,/3) (54) 
and the theorem is proved □. 



Proofs of Theorems i_ 

In this sketch we are going to show how to get Theorem ([2]) in some details; 
It automatically has as a corollary Theorem (|3]) which ultimately gives, as a 
simple consequence when applied on filled monomials, TheoremQ. 
Let us assume for a generic overlap correlation function Q, of s rephcas, the 
following representation 

a=l i° 1=1 

22 



where a labels the rephcas, the internal product takes into account the spins 
(labeled by /) which contribute to the a-part of the overlap qa,a' and runs to 
the number of time that the replica a appears in Q. The external product 
takes into account all the contributions of the internal one and the / factor 
fixes the constraints among different replicas in Q; so, for example, Q = 
512^23 can be decomposed in this form noting that s = 3, ra^ = 1, = 2, 
/ = A^~^5ji j35j2 j3, where the 6 functions fixes the links between replicas 
1, 3 — i> gi,3 and 2, 3 ^ g2,3- The averaged overlap correlation function is 



a=l 1=1 



Now if Q is a fillable polynomial, and we evaluate it at t = 1, let us decompose 
it, using the factorization of the u state on different rephca, as 

(Q), = E 5^ /(K), m n ^^iU <r) n ^^(H 4)' 

, a , a=l 1=1 b=u 1=1 

where u stands for the number of the unfilled replicas inside the expression of 
Q. So we split the measure fl into two different subset Ua and ut,: in this way 
the rephca belonging to the b subset are always in even number, while the 
ones in the a subset are always odds. Applying the gauge — > a1a'^^i,yi G 
(l,iV) the even measure is unaffected by this transformation (a^+i = 1) 
while the odd measure takes a aN+i inside the Boltzmann measure. 

(Q) = (55) 



b 



7-0 a=l 1=1 b=u 1=1 

At the end we can replace in the last expression the index + 1 of aN+i 
by k for any k 7^ {if} and multiply by one as 1 = A^~^ J2k=o- Up to orders 
0{1/N), which go to zero in the thermodynamic limit, we have the proof. 

It is now immediate to understand that Theorem ([2]) on a fillable overlap 
monomial has the effect of multiplying it by its missing part to be filled 



(Theorem 
(Theorem 



), while it has no effect if the overlap monomial is already filled 
4). □ 
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Proof of Proposition [T] 

The proof works by direct calculation: 



dt 



dE 

~dt 

Ewe 



afe 



e:=i(/3<^;i-<^"p-i) 



'0 



2aE 



nt(F,n^^i(cosh/5 + a^...(T%_, sinh/3)) 



'0 »b 



L a(nU(cosli/5 + sinh/?)) 

*0 



2aP-i(E 
Now noting that 



*0 «o 



'0 «b 



I \ ^ ^1 ^1 O'i I 



a<b 



1 



1 - scjt6' + 



S(S + 1).2 



2! 



we obtain 



dt 



2aP-^ ( E 



s 

a=l 



X ^1 — SCOtd 

from which our thesis follows. □ 



+ } (To...CT"_icr''i...cr^p_i6'^ + ... 

*0 «0 *o «0 



2! * 



- {Fs)t 
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